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“Introduction ~~ : ; : 


~ ] e 
= ° 


it should ae apparent to every educator that a large number = researchers 
have examined — effectiveness of 2 yerteey of, teaching practices and 


pice In less than a decade, thousands of “stitdies have been conducted 


on such topics as the instructional styles, interaction patterns and peraonalTey 


characteristics of teachers, the organizational structure of ors thé ; 
~ ys ——— 


technology of instruction, and the affective and cognitive peoueh of pupils, to ; 
; : 


sme only a few. In the course of these investigations, researchers have 


4 


‘ .« ‘oped hundreds of psychological and educational instruments to study teacher 


Som, 


and pupil behavior in the classroom. This book is designed to bring before aS > “! 


\ 


the educational community the instruménts used in these studies, so that readers 


\ * 
3 * me oe i ene tee ? : * bed 
> : ae 


may extend and .elaborate upon ,them,; ; 


. a 
‘ é . ¢ = 


“a 


| 
Saat : , ; : 
In reviewing empirical studies of teacher effectiveness for the Evaluation ra 
\ } . o 7 ¥ 


of Teaching Project at the Research and Development Center for Teacher Education, 


¢ 
=” 


the authors found the research generally characterized by four problems: ‘ 


1. a narrow range of measufemetts frequently employed 


: in individual studies of teacher behavior;: " ‘ 
a % ° ° ° ° ° \ - . 2 
‘“ oe inconsistent use of specific instruments across “ : e 
studies méasuring the same or similar hypotheses; 
, mt . > a 
S lack of a generic framework or guide from which to ° mS 
™, 
“~.select behaviors to be measured in the classroom} and. * 
a a 
e We, Pa 


4. “use, of instruments with inadequate psychometric 
characteristics to measure these classroom behaviors. . : 


_ 
- 


Problem 1: Range of Measurement 


This first problem came to the authors’ attention from an examination of 
: we * e 8 a ¢ 
literally unde ds of empirical studies® investigating relationships between. ms . 


teacher behaviors and pupil outcomes (Borich & Fenton, 1977; Kash, Borich, & 
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Fenton, 1977). During this review, the authors noted the inordinate number of 


research studies which measuréd only a single criterion behavior. unere it was 


% 


apparent that a single criterion provided investigators with a parsimonious 


a 


researcn design and a "clean" interpretation. of results, the large qumbee of 
nonsignificant findings produced by studies of this kind suggested that such 


simplistic methodology represented too narrow and theoretically vacuous an 


approach to measuring classroom behavior.’ A number of. studies defined teacher 


a -béhavior,, treatments, or instructional programs so broadly that the reader ,was 


a led to expect wide ranging effects upon pupils. Yet in many of these .studies 


3 


only one treatmént or teacher effect’was actually measured. Even when multiple 


" 


er . criteria were used, they were often applied to only one area of behavior (e.%.,.° ? 


.classroom interaction variables) or to closely related areas (e.g., self-, 


al 
t 


pupil, and supervisor evaluations of the teacher). *Rarely did researchers 
* e z 
employ ingtruments that capturéd a range of both pupil and teacher affective and 


cognitive behaviors. Surprisingly, concurrent measurement of teacher process 


a 
fe 


and pupil pxoduct variables was infrequently incorporated into research designs, 
y . > 
.. and few investigators focused on causal sequences of behavior which might ‘have 


° accounted for the effects of classroom instruction. This limited scope might 


° em 


s 


have been evero=s had résearchers utilized a multivariate aaprosel to the study 


a, ae . a ed m= aban: 
* « 


of ease toon behavior, pennere similar to that illustrated in Figure Ls. Most ° 
of the research encountered in our review deait with only a single "elice" of 
the clagsroom behavior shown in this-model: relatively few studies investigated 
the sequence of classroom pahaviers: taking into account the interactive effects 


’ ; oan ‘ « 
of context, classroom, school, pupil and teacher variables. ‘ 
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Problem 2: Inconsistent Instrument Use 
A second problem-which emerged from the literature was the inconsistent use 


-of any oné instrument across ‘studies purported to.be conceptually similar. In 


' rl 


a number of eneess there were as many measures as there were studies, eance no 


* » 


e 


two investigations saploves: instruments woich possessed the same reliability or 


6 > 


validity and measured vark£ables operationally defined in the same way, regardless 


r 


of the supposed similarity between the constructs assessed. It was apparent that 


researchers preferred to develop their own instruments, rather than to use or 


+ 
- 


Scere those already constructed for the same or simiiar purposes. This emphasis 


® 
* * < 
NO a gm ee me ee ee 


ae lle at 


on new instrument development seems to have reduced the opportunity for research- .— 


2 


ers to improve upon existing measures, to replicate an instrument's reliability 
and validity, and to use the same operations to measure the same constructs. 


: Replication of research findings is moré likely to occur under some 
4 , : 
; conditions ‘than others. For example, valid replicated results are most itkely 


~ a 


to be obtained when the same instrumentation ba used across studies which test 


« 
mh 


; the Same hypotheses. Less congfuence between findings is expected when different > 
- instruments purporting’ to measure the same variables are used within the same 
study; and even less agreement is anticipated when such instruments are tised in 


different studies. Aithough findings replicated across studies using different 


* 


instruments are encouraging, the most systematic approach to replication involves 


a 


Use of the same instrument (and, therefore, the same operationally defined con= 


& se 
* 


structs) in different studies. Given that "no significant differences" are 


& 


generally the norm in classroom research, we can place most confidence in those 


e *. 


"no difference" Evadinne which are replicated across studies using the same 


\ 


° instrument, somewhat less confidence in those obtained with different instruments 
, in the same study, and least confidence in those produced by diffarent studies 


t 
using different instruments. ey 


a 
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Problem 3: Lack of a Measurement Framework i 
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A third problem apparent from the literature was the absence of an overall 


framework or model to guide researchers in selecting teacher and pupil -behaviors | 
. : ie 
: > ..to be measured. Few researchers provided rationale for the kinds of teacher 7 


behavior they assessed, and even fewer, showed“interest in (or knowledge of) the , 


causal sequences of behavior possibly prerequisite to the single variable they _ 


did measure. Although promising process-product relationships (Rosenshine, 


” 


1971) sometimes encouraged researchers to collect both sadher and wap ll dave eiehin 
the same study, many times other’ variables (e.g., context, ethnographic,. presage, a? 

--and affective) were ignored. Researchers seemed ayense to studying those 

‘behaviors which were prevedutadee to teacher process variables or which. were . 


rd 


likely to confound the medsurément of ‘student achievement data. Figure 2 sketches 


the general type of eclectic framework from which investigators must work in order to, 


Ld 


we 


assure that ee eecers school, context: eearen! and pupil variables, as well as 
& 


the relationshios among these’ variables, are included’in the’ research design. 


. a 
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Problem 4: Psychometric Standards 
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Our ‘review of the literature also revealed the gross psychometric inadeuacy- 


e 
x » mt 4 4 a 


\ . “ 
‘ Of most tests and m@asures used in these research studies. The, literally hundreds 


* 
. ? 


of instruments employed in the field of teacher effectiveness researcl had been 
. . : 


- 


‘ f 
Subject to little critical assessment, and in the rare cases when such assessment 


? 


had been conducted and reported in a journal article or test manual, researchers 
¢ 


a 
Pe 


seemed—to be unaware of or indifferent to it. , In addition, when psychometric 


4 . a5 . 
cs evaluations were available, the instruments were generally judged according to 


absolute, rather than relative standards. Few sourcés currently exist wherebv 
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i a 
A % : 
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/ _ one can judge the reliability and Uenreney of an instrument in relation to the . 


perseeeaey and validity of other instruments with similar sbjeckives.. It was ° 


ad Pada * 


not uncommon, therefore, fog researchers to choose an instrument with relatively ‘ 
* @ é . ‘ 


iow vadidsey and Gel vant itew -eichout eextisias that a more reliable and valid 
instrument, was avaviabic and suitable for measuring the same construct. , 
: Revision and further development of an existing instrument would in many cases 
have been more appropriate aaa Seeduceiae than construction of still another _ 
. desecuaent of equal, Or more sueeeioadi io: reliability and validity. The - y 


inadequate psychometric. properties characterizing many .of the instruments in 


1 go wv G ° 7 . 
the studies reviewed, and the apparent availability of other more appropriate 


“og 


~ 4 ee gs “ as 


measures, suggests that generally no systematie approach was used in selecting 
LS ?. ® 


w 


# 


taese instruments. ‘ 


It is important to note that researchers, for whatever reasons, rarely 


e ’ * ec 


reported adequate peychometrié data concerfing the structural - “integrity of their 


Y 
» 


. instruments. They provided little information about replicability, eonS taney; 


. 


uniformity, and .stability of the measures they used, even when an instrument had 





. not previously appeared in the research literature. Replicability refers to the 


- extent totwhich a pattern or configuration of the behavior being measured recurs 
a ‘ 


. ; hee 
in essentially the same form in random samples on different oceasions. Constancy 
2 


a , _is the degree to which a pattern or configuration appears in essentially the same 


form at different score ranges ‘(e.g., Do pupils scoring low on, an anxiety instru’ 


ment demonstrate the same ore ennen of itens as pupils ets high on the 


+ - ° 


instrument?), Uniformity refers to invariance in or similarity of the pattern 


across selected groups with varying characteristics (e.g., configurational simi~ 


jarity*across race, sex, SES, age, etc.). And, stability involves consistency of 
¥ a & t 
P the pattern across two Or more administrations or the instrument to the same sub= 
+” i 


jécts. ~The yecucuiead “integrity of an instrument is ‘determined by ali rour of 


re = 
- %, 
a 


° “ * e 
“ y . « ¢ 
“y . ae 
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the above" characteristics, and the extent: to which an instrument has structural 


~ 


integrity in turn determings the reliability of the eons ee created to. explain” 


} 7 
observed regularities... . _ & 8 _ : ’ 


3 . i 
An even greater number. oe studies failed to provide information about the 


* 


validity—~particularly the cobvergent and ical a ,the instru- 


« 
e 


ments used. pouvesoone validity is a confirmation of traits (oz vaiclabiies. or 


categories) by independent measuring methods that requires significant correla= 


@ 


tion between two methods measuring the same trait. Discriminant validity is a 
& 
ce * 
requirement that *the correlation between Ghriee at measure: measuring the same 


@ 


trait exceed (a) the correlations obtained between that trait and any other trait 


not having method in-common and (b) the correlations between different traits 


‘ od #e hae’ x A 


which happen to employ the.same method. By determining intercorrelations among: 


+ 
%* v 


constructs ina multitrait-multimethod matrix, one can identify categories which : 


& 


pass Pee tests of eonyeeeene and discriminant validity. (See, for example, 


\ | 
‘the nédel by Borich and Malitz, 1975. ) + , ares 


» 


‘ ‘ 


| Sourcebook Objectives . : 


‘The above four problems have had a considerable influence, upon the design 


4 


¢ a 


and development of this.sourceboek. Given the four probiems ‘diagnosed above, the 


e 
» ® a 


objectives of this sourcebook ‘are: : : 


¥ > ‘ 


1. ‘to provide a comprehensive review af currently available instruments 


i . 
selected-across different aréas of inquiry in order to encourage 


. 


‘ , multivariate models of classroom research; 


° w 
* e 


ox. eompeeai le a descriptive framework and organization that will enccurageé 


¢ 
. 


} educators to return to the same pool of instruments, thereby promoting 


* — RO A Ye Et Ore, 


more consistent use of instruments across studies and investigators; : 
3. to report areas of inquiry and variables commonly researched, as well 


as those rarely studied (perhaps due to a lack of instrumentation); and 


a 
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eo 


- 
aa eo ae 
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“p ai ct, of" observe; and (2) the fact that research produced over the past two 


_ oo 


— - 43 


4, to provide data concerning the structural integrity of instruments 


Nos , 
_ : ° 2 


and to evaluate these. instruments according to relative standards 


= 


by grouping them inte conceptual categories which allow users to 


“4 


: determine their comparative as well as their absolute psychometric ' 
value. = S —~ . eae 
Generic Framework for the Instrument Search 


In order to develop a framework to guide the Selection of instruments for 


* 


the sourcebook, the authors reviewed all relevant teacher behavior research and 


r a = a gy 


evaluations pub lished during the period from which instruments would be chosen, 


"as. 


i.e., roughly 1954 through 1974. Using Ryans’ 1950's study of teacher 


characteristics (Ryans, 1960) and the pope noacton ee the Second Handbook of 


Aaa = 


" Research on: Teaching (Tfavers, 1973) as bounding points, ie authors consulted 


significant journal articles, books, and monographs in sede to define parameters 
‘ *% = / : 


for the sourcebook. From this, review of the literature, two gerieral dimensions 


® * 
ay 


were selected for tHe purpose of categorizing classroom behavior and the 


tc, 7 


instruments’ uséd.to measure it. These dimensions were: (1) _type of behavior 


a 


on a peouesecpeo dace. continuum; ,and (2) tevel of inference eetaiecd in measuring ~ 


behavior. . - 2. ’ . 
v x > e ® 


Process~Product Stages . 4 eae 


. 
‘* & * 


a ¢ & 4 Ld 
_The inclusion of instruments covering a variety of process=product 


4% 


he 


information stemmed from (1) the authors’ conviction that researchers should - 


eglicitly state in advance the specific behaviors they are attempting to 


* 


ia 


decades has repeatedly revealed ee varlance ‘between faa within process= 


iy 


product: stages for both teacher and pupil behaviors. , 


The process-product continuum used in selecting instruments for he source= 
aes ; h 


a 
”~ 
o x3 


book contained four stages: (1) a preoperational Stage characterized by 4 
aye” . . f i 2 . 


fe 
\ 
1 


e} 


a a" = 
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& 


the collection of antecedent, covariable, and predictor, information such as 


, personality, attitude, cognitive ae achievement, experience and aptitude 
4 ‘ 7 « 
be _ data on pupils and teachers; (2) an immediate process stage during which the 


‘ 


ongoing, interactive behaviors of both Ene teacher and the learner are assessed, 


* 


: usually through systematic observation sediae sthemes and elasstcon: climate 


inventories using either a rating or counting metric; (3) an intermediaté process 


a 


stage involving self~-, peer, supervisor, and pupil ratings of the teacher; and 


C4) a product stage characterized by assessment of affective and cognitive pupil 


behaviors across content, subject, and grade level. 


4 
¥ 


Level of Inference : 
” A = 


wa 


The second*dimension' used to guide the search for instruments--level of 


inference--has received increasing attention*as a result of evidence which has 


: 3 4 ’ \ 
shown that relationships between teacher behaviors and pupil outcomes differ 
depending upon whether teacher behavior is measured in a high- or low-inference 


. a ; og a | 
fashion. High-inference behaviors aré general characteristics of the teacher's 


"enthusiasm," “organization”. or "clarity," which. are 
° 7] ee om = 
ao “ ig ae s £ 
measured by overali catings: or observations. Low-inference behaviors, on the 
wr % : 
a on Fe 


other hand, are discrete and easily observable units of activity, Such as 
i 


> Ld 


; ‘ Mee 
“teacher asks question," "student gives correct answer" or "teacher reinforces 


performance, such as 


Pd 
t . ao 


a ; 5 “ : . . % ma © 
Student." These behaviors are measured in terms of their presence’or absence 
© ™ 

, - na ‘ 7 $ . oe i % 
and are so clearly defined prior to coding that little inference is required of 


—_ 
* a 


“the observer in deciding whether or not a particular behavior occurred. 


Pa ” 


Contrary to initial expectation, high-inference measures of teacher 
>» 


¥ behavior have often led to the strongest and most significant findings in 


“ the research” literature. Such findings and related conclusions have recently 
Ny * . : ‘ 


z 


” ® 1 i iz s s s s ‘ ‘i < e 
Srinulaced interest in and examination of high~inference measures, ‘while 


‘at the same tine encouraging revision of ee ee techniques, which offer 
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the advantage of greater definition and specification of the teacher's 


- performance. vis-a-vis a ‘specific pupil outcome. 
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. Classification Scheme | -  & 


¥ 


. Instruments in the sourcebook were organizéd. according to who suppliés 
. “ : 7 - : 


a information -about whom. This informational approach,diagramed below, was 


designed to accommodate the instrument's intent ag well as its, place within a 
. i “ 
broader framework of classroom research, 


a 


INFORMATION 


About the — About the _About the 
TEACHER PUPIL “ CLASS ROOM 


From the | : . 
TEACHER _ : , 


From the 
‘ 
" ’ 


, From an 
” OBSERVER 
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ag “ a vag 
The nine classifications represented on the grid are by no means mutually ~' 
. ig Sah 


exclusive. Many measures, for example, can be used to obtain information about 


a 





“ 
K 


either the teacher or the pupil, and many can be completed by a teacher or an 


’ 


observer. Generally, instruments were placed in a particular category on the 


basis of previous or most likely use. Observation coding systemgy providing 
- 
, . 
information about both the teacher and the pupil were classified under area 


IfTI€,. The number of instryments varies from category to category, reflecting 
* x 


the state of instrument development which exists in the literature. There are, 
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~ , for example, many measures designed to yield data about the pupil, while 


comparatively few are available for assessing classroom climate, an area of 


e 


relatively récent gee . j 2 


This classification scheme represents an attempt to place- instruments in - 


Hi 


-_ * i ) + 
a broader réSearch eon es es thereby encouraging educators to review the measures. 
¢ * ‘ * — * 





in each column and each row before making selections. It is hoped that in this 


wr 


= > ; : . : - 4 
manner the sourcebook will promote replication of studies and more Consistent , 


x J 5 


use of multivariate designs for classroom résearch. The instrument classification 


= x 
cd 
* 


pictured above avoids any single philosophical oriéntation toward the study of 


' a ° “Oy 
teaching in favor of a multivariate approach, _ - 3 


L 
Criteria for the Selection of Measures 
——— ew.<.$.{w9wW\eeN§W}ews>?9moO9a0anauaOaSauaOaOOOeeSeyy 
* es 2 ~ 1 « “ 
The five criteria listed below were used in selecting instruments for 
sf ; 


~~ « 
a 


inclusion in the sourcebook. ae - 
' ; > . _ " 4 


; + e + bd 2 a ‘ 
1. Initially, instruments were reviewed without reference to the field 


x : ae 


of classroom behavior in order to cover all measures of possible use to 


° 
\* 


e 


rd 
\ 


~~ _.earchers. Later screenings focused more sharply on those instruments 


‘ capable of providing a specific and/or unique contribution to the study of 
s 


classroom behavior. The first criterion for selection, therefore, was’ that 


‘ 
« 


each instrument (a) relate to a major area of inquiry posited by the teacher 
~ <* “~ 
research Literatures and (b) identify s specific teacher or pupil variables for . 
/ ; 


studying classroom ‘instruction. : % , 


? 
” 
4 7) 


' 4 : : . =< a . 
2. The second criterion for, inclusion tequired that instruments apply 


a 
a ok 
a 


to the classroom setting as opposed to the laboratory. Measures involving 


complex apparatus and contrived experimental devices were purposely excluded 


? 


« *4 


from the sourcebook. Racent writings (@ng.,. ioseusntae ‘ana Furst, 1973) have amply 


~ Mee oe 


‘3documented a need to establish gqneral relationships between teacher behaviors 


and rpupil outcomes in field elagercons before initiating intervention “ 


strategies to determine whether or 
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not these relationships are causal. Therefore, instrumentation which can be 
applied in ongoing classrooms should be of most value at this point. The 


sourcebé6ok focuses on those instruments which are most appropriate for use in ‘the : 


classroom and compatible with time and sdntarevediise constraints associated 


with field Settings. + anes . 


3. The third selection criterion involved the instrument's availability 
to the research community. All instruments in the sourcebook are available 


from “commercial publishers ér public sources, such as journals, books, reports, 


- 


monographs, dissertations, and reviews of research. The Boers and sunnier 


* 
. 7 ! 
vig * 


from which instruments were drawn were obtained from libraries or pub pede. 


: 
ries a * 


Reports and monographs were obtained either from their authors (who are identified 


in ae sourcebook) or from the ERIC Document Reproduction. BOEVECes P. 0. : f . 


= eases 0, Bethesda, Maryland 20014. Dissertations were available either on 
: - a loan basis from the library at ‘the degree granting institution or from 


University Microfilms, University of Michigan, Ann Arbor, Michigan, * 


« 
my + 


Reviews of research were available as mooetapaes as chapters ae commercially 


: available eaares such as the First and Second Handbooks of “Research. on Teaching 


$ > t 
(Gage , 1963; Travers, 1973), or as supplements to major educational and 


‘eo 


Fd x 


wy , 
, Psychological journals, e . “as 
: a4 


When an instrument could not be obtained in full, either from the author — 


~ 
~ 


or con one of the sources listed above,. that ing trument was not included in 


» v 
cal J ” 


the sourcebook. Therefore, the reader can eneteiate that each measure - 


reviewed’ is available from the : source cited at the beginning of each evaluation. 


mm 
> *¥ = E 
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4. Each instrument included in the sourcebook was also required to have 


been employed in one or more Studies wherein its psychometric characteristics 


e 


Oe i ‘« . ee 
were evaluated. Instruments which have generally remained unused were not 
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Tne Aneluded in this volume, Use, however, did not insure inclusion. In some 
a a aa 


rn atne eater, 


eases, sasures used in pilot studies or exploratory designs were excluded 
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pecause sample sizes were too small or research contexts too ambiguous to 


allow evaluation of the psychometric characteristics of the instrument. Many 


observation coding systems, already reviewed by Simon and Boyer (1970), were 


not evaluated in this volume since few research studies were available from 


which to judge their adequacy. Only the most Roeeeey used of the instruments 
appearing in Simon and Boyer were included. The bibliography which 
accompanies ace review in the sourcebook reflects to some extent the instrument! Ss 


past use and sieesanaeces of further information about its psychometric 


% 


“« properties.’ — ° 


” 


5. The final selection criterion pertained to the test author's definition 
ns | : 


“= 


of the construct or constructs being measured. A statement of operationally : 


o 


defined constructs, referring to specific teacher or classroom variables, or an 
, , ” : . ; i. ee 
attempt (past or in progréss) to determine factorial validity, was required of 


each ins trument included in the sourcebook. - 
* > 


r , Other Instrument Reviews. 
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~y 


Before compiling this sourcebook, four major instrument reviews were 


wy 
er 


* Py r 


consulted in an effort to profit from the organizational insights of other d 


r* « 


authors and to avoid the pitfalls which seem to have diminished the usefulness 


of their work. The four sourcebooks most closely scrutinized were: CSK+RBS 


1 
4 ™ 


“Test Evaluations: BoE of Higher-Order Cognitive, Affective, and Interpersonal 
* é 


 Seitds (Center for the Study of Evaluation, 1972) and its eoeanses volumes; 


4 


Johnson and ee ee s Tests and Measurements in Child Hees topnents A Handbosk 
—ee eee essen in Vhiid vevesopment; A handbook 


(1971); Shaw and Weight’ Ss Scales for the gieas urement of Attitudes (1967); and 


‘J 


the Simon and Boyer eae Wares for Behaid ox (1970). Secondary works 
a * 


consulted For both style and content included Buros' Mental Measurements 
Se 


Yearbooks (1953; 1959; 1965; 1972), Measuring Human Behavior (Lake ; Miles, & 


Earle, 1973), sociLoemotional Measures for Preschool and xindergarten Children 
5 ee ee 


$ 





Ps . 
‘ & 
“ 
? 
H* ” . * Me 
a 
rn - Fs, 
. ws 
Qo: - 
% 


‘ as 
. ‘ = . ¢ *» ° 
. E | C . ° rege 
¢ z ee ea tae 


* 
A cult text Provided by ERIC Rei 
“ 7 . + SRS Seman sitar. 5, 
* a: . . 











ds 


ERIC - 


A Fut text Provided by ERIC 
. 





(Walker, 1973), Measures of Social Psychological Attd tudes (Robinson & Shaver, 
. 1969), the ETS test file at the Carl Campbell Brigham Library at Princeton, 


New Jersey, and the Cornell University Test List (Cornell University, 1960). 
After reviewing the above volumes, the authors determined that the present 


sourcebook should include the following information. 


Name of instrument 
Author of instrument 


Type of measure: rating scale, self-report questionnaire, 
projective test, performance test, checklist, observational” 
coding system, sociometric questionnaire, cognitive ability 
test 


Availability of instrument 


Description of instrument 2 & 
Q ‘s 7 : 7 
a. Purpose - - 


se 


a” 


~ 


5. . Bopulation—for-whom it is appropriate’ ~ 


c. Variables measured, . with reference to other Studies , 
wherever possible | oa 


d. Suhecsies or factors - e 
3 . x a x 


e. Context in whtes the instrument was developed 


eR Oe 


-Illustration of sample items and response formats similar to 
those appearing on. the instrument . 


w 


Psy.chometric characteristics 


a. Reliability , Ae 


sa Potacnal Moneteceney , | 
‘ii. Equivalence of forms 
adi. Stability, a 4 eo 
-iv. Intercoder agreement when appropriate 
b. Validity E 


. di. Content (source of items, adequacy pf Beneaes item 
-and factor analyses) 


ii. Predictive (criterion, number and type of cases, 
result) p ; 


es 49 














@ 





"¢ e 


iii. Concurrent (ériterion, number -and type of cases, 


> on result)~ . Sa 
$ - s . . a 
iv. Construct (type of evidence, reSult) _ ‘i & _ — 
4 » , F , 
» a > 
: 8. - Norms - 4 
| oe . , 4 
a. Type and adequacy of norms — , - = . : 


“ 
? . 7 é été ° 
. 


b. Derived ‘scores * 


~ « 
a ¢ 


c. Suggestions for use . i 


; 2 9. ° Administration and scoring 
| a. Clarity 
'b. Existence of manual or writren directions _ 
so ee, Adminiétration, time <0 : - = ° 
7 d. Training requirements for administrators and observers 
he oF Type of scores obtained 
oe : f. Searing procedures . . : ° 
_  g10. Comments (evaluative remarks about the ineveamene’: useability . _ 
. and psychometric adequacy) : 
Ll. Major references . | : ae - — a - 
x Sb These categories represent the" organizational format of the reviews ; . 
appearing ia the, sourcebook.. The Description, Reliability, -Validity; and 
: . a ; 
Comment sections constitute the major part of each review. The descriptive . 
ee _and psychometric categories provide. objective data from which the reader may 
.draw his own conclusions about fhe adequacy of the measure, while a final, evaiaseive 
: n 
7 section presents the authors! perception of the instrument's strengths and 
weaknesses. - ~~ 2 / | 
Sources of Instruments | . oe 
“EOE kinds of sources were used in identifying instruments appearing ns 
. % 
this sourcebook: (1) journal articles; (2) books; (3) reports; and (4) reviews 
of research. Though these sources were consulted for the years 1954 to 
9 | ) ‘ Zu ; . 
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1975, the instruments in the sourcebook cover a broader period since the 


a 


e 


literature contained references to instruments currently in use but constructed 


% 2 


pridr to 1954. The starting point of the review intentionally corresponds tio 
‘Ryans! classic study of teacher pageeceer sence which began in the 1950's and 
culminated in 1960 with the pute seton of Characteristics of Teachers aa 


. 1960). The authors feel that this research represents a milestone “in the 


aay 


Study of teacher behavior. We believe Ryans' work, quite apart from the instruments it 
: 
- produced, eroded impetus for a decade oe poee hs classroom research ° 


4 
on” * 


eae followed. As the instruments in this goucnsbook clearly reveal, interest 
wv : i 
7 in classroom research and evaluation has been ineeesedng rapidly since the 


ny 


Ryans study and is now a significant field of inquiry. ; : 


Journals: consulted for purposes of instrument selection included all those 
in which empirical studies related to giaccroon instruction might appear. Among 
‘eee were education journals, along with several. psychological journals noted , 
tor publishing teacher-behavior eeecareh. The periodicals of the American 


at 7 . . fe 
é ? 


Educational Research Association (the American Educational Research Journal) 


m 


a 


and the Review of Educational Research) were consulted along with the American 


. 
? & 


Psychological Association's Journal of Educational Psychology. Other journals 


m searched in the field of general education were the gourne! of Educational 


Research, oo of Experimental Education: Journal 2 sociology. in Education, 
Journal’ ‘of Teacher Education, Phi peta Kappan, Bree ciiun Theory Network} 


—— into ‘Practice, ecueaerena ‘Researcher, the Harvard Educational Review, 


@ 


and° the Classroom Interaction Newsletter. Several journals related to 


te specific content areas were reviewed as well. These included the Journal for 


~ 


Résearch in Mathematics Education, Journal of Research in Science Teaching, 


=" * 2 ta » 
t 


Science Education, Social Studies, and the Reading Research Quarterly. Articles 


in these journals often served as leads directing the authors to stili other 


? 
7 journals which provided descriptions of additional instruments. * 
~” "4 
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Professional texts and books provided a second:.source of instruments. 


Both major textbooks and less widely distributed monographs were reviewed, 


Typical of these were: Biddle and Ellena's Contemporary Research on Teacher 


Effectiveness (1964); Bolton's Selection and Evaluation of Teachers (1973)3_ 
Dunkin and Biddle's The Study of Teaching (1974); Gage's Teacher Effectiveness 


and Teacher Education (1972);‘and Westbury and Bellack's Research in the 


s 


Classroom Processes (1971). Other books, such as Rosenshine's Teacher Behavior 


td o baal 


and Student Achievement (1971) and Brophy and Good's Teacher-Pupil Relationships 
(1974) provided valuable leads to journal articles from-which new instruments 


were eventually identified. 


° 
a 


; A third source of instruments includéd reports, monographs and unpublished 


a 
ve 


- * * ‘ 3 « v 
dissertations. These sources, though commonly circulated among educational 


researchers, were often otherwise unknown. Within this zgroup. were relatively.. 
_< . ‘ : x 


a 


obscure professional -papers delivered to the American’ Educational Research’ 


a LA 


Association and the American Psychological Association, the latter appearing 


a 


wt 


" - ‘in the proceedings of Division 15 (Educational- Psychology). 


»fajor reviews of regearch, such as those appearing in the First and Second 
ieee: oe ae 


tad 


Handbook of Research on Teaching (Gage, 1963; Travers, 1973) ‘and in Smith's 


Research on Teacher Education (1971), served as a fourth Source of instruments, 


*. 


€ 


@ “While no search can uncover all of the “instruments of possible 
ab . a 


‘ ¥ 
a 


use to educators, the authors believe that the literature review described 
above was reasonably successful in identifying a significant subset of instruments 


for evaluating classroom instruction. The sourcebook contains a variety of 


- 


. strategic information needed by evaluators,. researchers, and students of 
‘ ; oe. . s 0 
teacher behavior. Its mix of technical, research, and administrative information | 


? 
e 


is designed to make this volume useful to the gteatest number of educators. 
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‘ Biddle, B. J., Good, T. L., Hall, P. H., & Bank, B. J. Institute for Research 
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